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ABSTRACT 



The modification of timestamps of streams of data packets 
for seamless branching is disclosed. In one aspect of the 
invention, a computerized system has a plurality of multi- 
media play devices, and a multimedia read device. Each play 
device receives and plays data intended for that device. The 
multimedia read device reads a stream of packets of data, 
decodes the packets into data, and sends the data to a 
corresponding play device at appropriate times. The appro- 
priate time is based on relative timestamps accounting for 
accumulated time gaps resulting from branches within the 
stream. The invention has applications including digital 
video disc (DVD) playback. 

57 Claims, 4 Drawing Sheets 
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TIMESTAMP MODIFICATION FOR ordinary skill within the art can appreciate, synchronization 

SEAMLESS BRANCHING among the timers for the substream decoders can be quite 

complex, especially where there are three or more substream 
decoders, and may require sophisticated timing circuitry 

FIELD OF THE INVENTION 5 within the DVD player 

This invention relates generally to the decoding of In addition the prior art is not suitable when a rapid 

streams of packets, where each packet has a corresponding sequence of time gaps is encountered because more clocks 
substream, and more particularly to the modification of might then be required. This means that this solution may be 

timestamps of such streams for seamless branching. prone to synchronization errors should something go awry — 

10 such that the video playback of a DVD, for example, does 

BACKGROUND OF THE INVENTION not "line up" with the audio playback. This could occur, for 

With the advent and increasing popularity of digital- example, if a decoder failed to deliver its data before it is 

video-disc (DVD) and compact-disc read-only-memory switched to the second clock which (if the clock was 

(CD-ROM) technology, as well as usage of the Internet, the switching to an earlier time) would result in a freeze of the 

viewing of multimedia that is stored as a stream of data 15 video of lea S m rou gMy equal to the time gap which may be 

packets has also become very popular. For example, with an nour or more wmle the decoder waited for the new clock 

respect to DVD technology, more and more movies and to reach the time corresponding to the timestamp on its data, 

other content are becoming available on DVD's, which are Therefore, there is a need for the synchronization of 

playable on dedicated DVD players intended for integration substreams of data packets intended for playback on differ- 

with a home stereo system, as well as on DVD players ent types of devices, that does not require the use of separate 

incorporated into a home personal computer (PC) system. timers for before and after a timestamp gap. Such a solution 

DVD's, and other media that store stream of packets should not require complex or sophisticated timing circuitry, 

representing multimedia data, typically are such that each an t d nor ^ P rone t0 synchronization errors that may occur 

packet is associated with a corresponding substream, where 25 w * tn - sucn circuitry. Such a solution should thus prevent large 

each substream is intended for playback on a different breaks or gaps from occurring within the playback of 

device. For example, a DVD might have two substreams, an streams of data packets that may result when branching 

audio substream and a video substream. The audio sub- occurs within such streams, 

stream contains packets of data intended for output to a o ¥T ww m , ™ 

device such as an amplifier coupled to one or more speakers, 30 ' SUMMARY OF THE INVENTION 

so that the audio may be heard. The video substream The above-mentioned shortcomings, disadvantages and 

contains packets of data intended for output to a device such problems are addressed by the present invention, which will 

as a television or monitor, so that the video may be seen. be understood by reading and studying the following speci- 

For such streaming data packets that are each associated fication. One aspect of the invention is a computerized 

with corresponding substreams, such that each different 35 system having a plurality of multimedia play devices (e.g., 

substream of data packets is intended for ultimate output and a television, monitor, or amplifier coupled to one or more 

playback on a different device, the synchronization of the speakers), and a multimedia read device (e.g., a DVD 

playback of the different substreams of data packets is player). Each play device receives and plays data intended 

crucial. For streaming data packets such as that stored on for that device. The multimedia read device reads a stream 

DVD's, timestamps exist within the stream, so that the DVD 40 of data packets(e.g., as stored on a DVD), decodes the 

player knows to output the data within a given packet to the packets into data, and sends the data to a corresponding play 

device associated with the substream for that packet at the device at the appropriate times. The appropriate time is 

appropriate time. However, because the stream of packets based on relative timestamps accounting for accumulated 

may also contain branches to other packets within the time gaps resulting from branches within the stream, 

stream, large jumps or breaks may occur within the sequence 45 For example, a multimedia read device, such as a DVD 

of timestamps. This is because the timestamps are typically player, may have at least a stream decoder and two or more 

preauthored into the stream of packets stored on a given substream decoders. The stream decoder looks at each 

DVD. packet of data to determine to which substream decoder it 

A DVD player, or similar device, must therefore accom- should be sent. When the packet of data is sent, a relative 

modate the synchronization of substreams of data packets. 50 timestamp is sent in conjunction therewith, instead of an 

According to the prior art, one manner by which this absolute timestamp from the stream. This relative timestamp 

synchronization is accomplished includes two timers with a rnay be calculated as Trel~Tabs-Tacc, where Trel is the 

fixed offset corresponding to the size of the time gap when relative timestamp, Tabs is the absolute timestamp, and Tacc 

a time gap is encountered. Each stream decoder is separately is the accumulated time gaps resulting from branches within 

switched to the second timer (the one corresponding to time 55 the stream. When a branch is reached within a stream, Tacc 

after the time gap) at the precise moment when it is deemed is incremented by Tto-Tfrom, where Tto is the absolute 

to have presented all its data for the time before the time gap. timestamp immediately after the branch, and Tfrom is the 

When all streams are switched to the second timer the first absolute timestamp at the branch. 

timer is updated by the amount of the time gap so that both In this manner, the invention provides for the synchroni- 

timers are the same and the stream decoders are all switched 60 zation of substreams of data packets without utilization of 

back to using the first timer, ready for any subsequent time separate timers for each substream decoder of a multimedia 

gaps. (The typical DVD player or similar device has a main read device. Rather, a relative timestamp is passed from the 

decoder that determines the substream type of each packet, main stream decoder to the substream decoders. Large 

and then sends the packet to the appropriate substream jumps or breaks within the absolute timestamps as a result 

decoder for such packets, the substream decoder then decod- 65 of branches within the stream are thus prevented, and not 

ing the data from the packet and sending it to the appropriate propagated to the substream decoders. It is believed that the 

audio or video device as output.) However, as those of invention also is not prone to synchronization errors, as may 
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occur in the prior art solution of utilizing separate timers for Moreover, those skilled in the art will appreciate that the 

each substream decoder. invention may be practiced with other computer system 

The present invention includes computerized methods, configurations, including hand-held devices, multiprocessor 

systems, computers, multimedia read devices and computer- systems, microprocessor-based or programmable consumer 

readable media of varying scope. In addition to the aspects 5 electronics, network PCS, minicomputers, mainframe 

and advantages of the present invention described in this computers and the like. Hie invention may ako be practiced 

summary, further aspects and advantages of the invention in f distrib , ut £ d computing environments where tasks are 

„ •„ . „ . u t ♦ Tu a i , performed by remote processing devices that are linked 

wiU become apparent by reference to the drawings and by * fa , J mmunic J ons netw * rk . In a distributed com . 

reading the detailed description that follows. ^ puting environment) program modules mav be Iocated m 

BRIEF DESCRIPTION OF THE DRAWINGS both local and remote memor y stora S e devices. 

The exemplary hardware and operating environment of 

FIG. 1 shows a diagram of the hardware and operating FIG. 1 for implementing the invention includes a general 

environment in conjunction with which embodiments of the purpose computing device in the form of a computer 20, 

invention may be practiced; J5 including a processing unit 21, a system memory 22, and a 

FIG. 2 shows a diagram of a computerized system in system bus 23 that operatively couples various system 

accordance with an embodiment of the invention; components include the system memory to the processing 

FIG. 3 shows a flowchart of a computerized method in unit 21 ma y be onl y one or there ma y be more than 

accordance with an embodiment of the invention; and, one processing unit 21, such that the processor of computer 

FIG. 4 shows a flowchart of a computerized method for a 20 2 ° comprises a single central-processing unit (CPU), or a 

specific DVD application, in accordance with an embodi- plura of P rocessin g units > commonly referred to as a 

ment of the invention. parallel processing environment. The computer 20 may be a 

conventional computer, a distributed computer, or any other 

DETAILED DESCRIPTION OF THE lv P e of computer; the invention is not so limited. 

INVENTION 25 Tne system bus 23 may be any of several types of bus 

_ , ril . , ... .. structures including a memory bus or memory controller, a 

In the following detailed description of exemplary peripheral bus, and a local bus using any of a variety of bus 

embodiments of the invention, reference is made to the architectures. The system memory may also be referred to as 

accompanying drawings which form a part hereof, and in simply the memory> and includes fead onl me (ROM) 

which is shown by way of illustration specific exemplary 3Q 2 4 and random access memory (RAM) 25. A basic input/ 

embodiments in which the invention may be practiced. output syslem (B i 0S) 26? thc basic routincs that 

These embodiments are described in sufficient detail to help t0 transfcr in f ormation between dements within the 

enable those skilled in the art to practice the invention, and computer 20, such as during start-up, is stored in ROM 24. 

it is to be understood that other embodiments may be utilized ^ computer 20 further includes a hard disk drive 27 for 

and that logical, mechanical, electrical and other changes 35 reading from and writing t0 a hard diskj not showD) a 

may be made without departing from the spirit or scope of magnetic disk ^ ^ for readi from Qf Wfiti to a 

the present invention. Hie following detailed description is, rem0 vable magnetic disk 29, and an optical disk drive 30 for 

therefore, not to be taken in a limiting sense, and the scope reading from or wdting t0 a removable optical disk 31 such 

of the present invention is defined only by the appended as a CD R0M or other 0 tical media 
claims 

40 The hard disk drive 27, magnetic disk drive 28, and 

The detailed description is divided into five sections. In optical disk drive 30 are connected to the system bus 23 by 

the first section, the hardware and the operating environment a hard disk drive interface 32, a magnetic disk drive inter- 

in conjunction with which embodiments of the invention face 33, and an optical disk drive interface 34, respectively, 

may be practiced are described. In the second section, a The drives and their associated computer-readable media 

computerized system of one embodiment of the invention is 45 provide nonvolatile storage of computer-readable 

presented. In the third section, a computerized general instructions, data structures, program modules and other 

method in accordance with an embodiment of the invention data for the computer 20. It should be appreciated by those 

is provided. In the fourth section, a computerized method in skilled in the art that any type of computer-readable media 

accordance with an embodiment of the invention, and that is which can store data that is accessible by a computer, such 

particular to a DVD application, is presented. Finally, in the 50 a s magnetic cassettes, flash memory cards, digital video 

fifth section, a conclusion of the detailed description is disks, Bernoulli cartridges, random access memories 

provided. (RAMs), read only memories (ROMs), and the like, may be 

Hardware and Operating Environment USC A d in * c ex * m P lar y gating environment. 

A number ol program modules may be stored on the hard 

Referring to FIG. 1, a diagram of the hardware and 55 disk, magnetic disk 29, optical disk 31, ROM 24, or RAM 

operating environment in conjunction with which embodi- 25, including an operating system 35, one or more applica- 

ments of the invention may be practiced is shown. The tion programs 36, other program modules 37, and program 

description of FIG. 1 is intended to provide a brief, general data 38. A user may enter commands and information into 

description of suitable computer hardware and a suitable thc personal computer 20 through input devices such as a 

computing environment in conjunction with which the 60 keyboard 40 and pointing device 42. Other input devices 

invention may be implemented. Although not required, the (not shown) may include a microphone, joystick, game pad, 

invention is described in the general context of computer- satellite dish, scanner, or the like. These and other input 

executable instructions, such as program modules, being devices are often connected to the processing unit 21 

executed by a computer, such as a personal computer. through a serial port interface 445 that is coupled to the 

Generally, program modules include routines, programs, 65 system bus, but may be connected by other interfaces, such 

objects, components, data structures, etc., that perform par- as a parallel port, game port, or a universal serial bus (USB), 

ticular tasks or implement particular abstract data types. A monitor 47 or other type of display device is also 
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connected to the system bus 23 via an interface, such as a play devices include televisions, monitors, other types of 

video adapter 48. In addition to the monitor, computers video displays devices, and audio amplifiers coupled to one 

typically include other peripheral output devices (not or more speakers and other types of audio devices, 

shown), such as speakers and printers. N 0 t shown in FIG. 2 is that the computerized system may 

The computer 20 may operate in a networked environ- 5 include or be a part of a computer, such as that which is 

ment using logical connections to one or more remote shown in and has been described in conjunction with FIG. 

computers, such as remote computer 49. These logical 1. That is, multimedia read device 200 may be a part of the 

connections are achieved by a communication device computer, or coupled thereto. For example, the computer 

coupled to or a part of the computer 20; the invention is not may have installed therein an internal DVD player, as known 

limited to a particular type of communications device. The 10 within the art, within a 5.25" bay of the computer. For 

remote computer 49 may be another computer, a server, a further example, the computer may have coupled thereto an 

router, a network PC, a client, a peer device or other external DVD player, as also known within the art, to a 

common network node, and typically includes many or all of Universal Serial Bus (USB), PCMCIA card slot (also known 

the elements described above relative to the computer 20, as a PC Card slot), a parallel port, or a serial port of the 

although only a memory storage device 50 has been illus- 15 computer. In addition, multimedia read device 200 may be 

trated in FIG. 1. The logical connections depicted in FIG. 1 a component within a stereo system, as also known within 

include a local-area network (LAN) 51 and a wide-area the art. 

network (WAN) 52. Such networking environments are Multimedia read device 200 comprises system stream 

commonplace in office networks, enterprise-wide computer decoder 204, demultiplexer 206, and substream decoders 

networks, intranets and the Internet, which are all types of 20 2 QSa } 2086, . . . , 208* The stream decoder 204 decodes the 

networks. stream of packets, and sends each packet to demultiplexer 

When used in a LAN-networking environment, the com- 206 with a relative timestamp. The relative timestamp 

puter 20 is connected to the local network 51 through a accounts for any and all accumulated time gaps resulting 

network interface or adapter 53, which is one type of from branches within the packet stream. Desirably, decoder 

communications device. When used in a WAN- networking 25 204 itself calculates this relative timestamp. Optionally, in 

environment, the computer 20 typically includes a modem an embodiment of the invention in which multimedia read 

54, a type of communications device, or any other type of device 200 is part of or coupled to a computer, a computer 

communications device for establishing communications program running on the computer (i.e., executed from a 

over the wide area network 52, such as the Internet. The computer-readable medium such as a random-access 

modem 54, which may be internal or external, is connected 30 memory by the processor of the computer) may calculate the 

to the system bus 23 via the serial port interface 46. In a relative timestamp to maintain the appropriate times at 

networked environment, program modules depicted relative which data is sent to the multimedia play devices. In such 

to the personal computer 20, or portions thereof, may be instance, the computer program may also be stored on 

stored in the remote memory storage device. It is appreciated another computer-readable medium, such as a read-only 

that the network connections shown are exemplary and other 35 memory, a floppy disk, or a compact-disc read-only-memory 

means of and communications devices for establishing a (CD-ROM). 

communications link between the computers may be used. The relative timestamp is relative as compared to the 
The hardware and operating environment in conjunction absolute timestamp that is typically preauthored into the 
with which embodiments of the invention may be practiced 4Q packet stream itself. By passing a relative timestamp as 
has been described. The computer in conjunction with which opposed to an absolute timestamp, the stream decoder 
embodiments of the invention may be practiced may be a provides for synchronization of the packet substreams, 
conventional computer, a distributed computer, or any other which is an advantage of the invention. The invention is not 
type of computer; the invention is not so limited. Such a particularly limited to the manner by which relative times- 
computer typically includes one or more processing units as 45 tamps are calculated; however, in one embodiment, the 
its processor, and a computer-readable medium such as a relative timestamps are calculated in accordance with the 
memory. The computer may also include a communications method of FIG. 3, which is described in a following section 
device such as a network adapter or a modem, so that it is of the detailed description. 

able to communicatively couple other computers. Demultiplexer 206 receives the packets from stream 

„ 50 decoder 204, and sends each packet, including a relative 

vs em timestamp as received from decoder 204, to the one of 

A description of a computerized system according to an substream decoders 208a,, 208b, . . . , 20Sn that corresponds 

embodiment of the invention is provided by reference to t0 me substream of the packet. Thus, each of substream 

FIG. 2. In the computerized system of FIG. 2, multimedia decoders 208a, 208b, . . . , 208* corresponds to a different 

read device 200 is coupled operatively to multimedia play 55 packet substream, such as an audio substream, a video 

devices 202a, 202fc, . . . , 202/1. The multimedia read device substream, etc. The invention is not particularly limited to 

reads a stream of data packets (not shown in FIG. 2), where anv number or type of substream decoders. Each substream 

each packet is associated with a corresponding substream, decoder receives packets of its corresponding substream 

and sends the data to a multimedia play device correspond- fr° m demultiplexer 206, including relative timestamps, 

ing to the substream at the appropriate time. The appropriate 60 decodes the data from the packets, and sends the data to a 

time is based on relative timestamps accounting for accu- corresponding play device 202a, 2026, . . . , or 202« at the 

mulated time gaps resulting from branches within the appropriate time. That is, when the system clock is equal to 

stream. The invention is not limited to a particular type of tne relative time indicated in the relative timestamp for a 

read device. One such device includes a digital video disc given packet, the data within that packet is decoded and sent 

(DVD) player. Each of the multimedia play devices receives 65 t0 a corresponding multimedia play device as output, 

and plays data intended for the device. The invention is not Thus, the operation of the computerized system of FIG. 2 

limited to a particular number or type of such devices. Such is as follows. Stream decoder 204 reads a stream of data 
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packets coming from a source such as a DVD. The stream, reading of this packet. However, the variable Tabs may also 

besides including data packets, also includes absolute times- not be incremented with each new packet, as those of 

tamps preauthored into the source (in one embodiment). ordinary skill within the art can appreciate. If the end of the 

Decoder 204 desirably determines a relative timestamp data packet stream has been reached (e.g., the end of a DVD 

accounting for accumulated time gaps resulting from 5 has been reached), then the method proceeds from step 308 

branches within the stream, so that the data within the to step 310, and the method ends. If a branch does not occur, 

packets are played and/or decoded at the appropriate time. control proceeds from step 312 to step 314. In step 314, the 

Demultiplexer 206 receives packets and relative timestamps packet read in step 306 is processed. A relative timestamp 

from decoder 204, and sends the packets with their relative represented by the variable Trel may be calculated in accor- 

timestamps to the appropriate substream decoder 208a, 10 dance with the formula Trel =Tabs-Tacc, to take into account 

2086, . . . , 208« depending on the type of substream of the any accumulated time gaps resulting from branches within 

packets. For example, where there are two substream decod- the stream, if the packet read in step 306 corresponds to an 

ers 208a and 2086, packets of an audio substream may be incremented Tabs (otherwise a new Trel is not calculated), 

sent to decoder 208a, while packets of a video substream This new relative timestamp (or the old relative timestamp, 

may be sent to decoder 2086. At the appropriate time, based is if a new one was not calculated) is then passed. For example, 

on the relative timestamps calculated by decoder 204, sub- the packet, along with the relative timestamp, may be 

stream decoders 208a, 2086, . . . , 208w decode and output provided as an output to a demultiplexer, for further direc- 

the data contained in their packets to the multimedia play tion to an appropriate substream decoder, as has been 

devices 202a, 2026, . . . , 202n to which they arc coupled. previously described in conjunction with FIG. 2. Control 

Because of the relative timestamps, then, the playback on 20 then proceeds back to step 306, where the next packet is 

the play devices of the data decoded by the substream read, and the variable Tabs may be incremented, and the 

decoders is synchronized. method continues as has been described. 

A description of a computerized system in accordance If, however, a branch did occur in step 312, control 

with an embodiment of the invention has been provided. The proceeds to step 316. In step 316, the variable Tfrom is set 

, computerized system has been described in relation to a 25 to Tabs. The variable Tfrom thus represents the absolute 

DVD-stored stream of data packets. However, those of time stamp at the detected branch. In step 318, the branch is 

ordinary skill within the art will appreciate that the invention actually performed (i.e., there is a jump to a new segment 

is not limited to DVD applications, and is amenable to any within the stream of packets), and the first packet within the 

stream of data packets in accordance with which the inven- new segment is read. Tabs also changes, to reflect that a new 

tion may be used. 30 absolute timestamp is now being referenced. In step 320, the 

variable Tacc is incremented by (Tabs-Tfrom), to take into 

Method account the time gap that has resulted from the branch just 

In the previous section, a description of a system accord- Performed. The amount the accumulated time is incre- 

ing to an embodiment of the invention was described. In this „ ™ nted * * e ° f time ^ etween tne new P osltion 

section, a method according to an embodiment of the referenced by Tabs (after the branch), and the position 

invention is described, in reference to FIG. 3. The method d by Tfrom (at the branch). Thus, the amount of 

may be performed by the system of the previous section, {im ?. advanced within the packet stream is accumulated 

such as by the multimedia read device (e.g., the stream ^ l 0 hin Tacc * From ste P 320 ' 0001101 P roceeds back to step 

decoder thereof), or a computer in conjunction with which , n 308 ' wht \ re » he P ackel stream is again examined for branches 

such a read device is being utilized. The method is desirably or tne end of the st ™ m ' or the P^cketjust read is processed 

a computer program stored on a computer-readable medium, as has been descnbed - 

such as a memory (random- access or read-only memory, for Thus, the method of FIG. 3, via the calculations Trel» 
instance), a floppy disk, or a compact-disc read-only- Tabs-Tacc and Tacc=Tacc+(Tabs-Tfrom), provide for the 
memory (CD-ROM). The description in this section enables 45 synchronization of decoding and playback of data contained 
one of ordinary skill within the art to construct a computer within the packets of the stream, by accounting for accu- 
program encompassing such a computerized method. The mulated time gaps that may result when branches are 
method of FIG. 3 is a generalized method according to one encountered within the stream. By passing the relative 
embodiment of the invention, and may be particularized in timestamp referenced by Trel, instead of the absolute times- 
accordance with a particular type of data stream, as those of 5Q tam P referenced by Tabs, the method ensures that the 
ordinary skill within the art can appreciate. For example, a accumulated time represented by Tacc is accounted for. The 
specific method for use with DVD is described in the next accumulated time represented by Tacc is incremented by 
section of the detailed description. ume S a P s resulting from branches within the stream as the 
Referring now to FIG. 3, from the start in step 300, control branches ™ encountered. Such calculations of relative time 
proceeds to step 302 and then to step 304. In steps 302 and 55 and accumulated are advantages of the invention. 
304, initialization is performed. In step 302, the variable A method according to an embodiment of the invention 
Tacc, representing the accumulated time gaps resulting from has Deen described. The method has-been described as being 
branches with a data packet stream, is reset to zero. In step performed within or by a system as has been shown in and 
304, the variable Tabs, representing an absolute timestamp, previously described in conjunction with FIG. 2. However, 
is also reset to zero. Note that the absolute timestamp may 60 lhe met hod of FIG. 3 is not so limited, as those of ordinary 
be reset to some value other than zero, depending on skiU within the art can appreciate, 
whether processing (and playback) of the data stream is 

starling from the beginning of the data packet stream, or at Specific Method for DVD 

some point away from the beginning of the data packet i n the previous section of the detailed description, a 

stream. The invention is not so limited. 65 general method according to an embodiment of the inven- 

In step 306, the next (first) packet is read, such that the tion was described. In this section, a particular method 

variable Tabs may be incremented in accordance with the according to an embodiment of the invention suitable for use 
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with DVD data streams is presented. Those of ordinary skill 
within the art will appreciate that the invention is not limited 
to DVD applications, however, and that the general method 
of FIG. 3 described in the previous section can be applied to 
any of a number of stream data types. 5 

Referring now to FIG. 4, from the start in step 400, control 
proceeds to step 402, in which the variable Tacc, represent- 
ing the accumulated time gaps resulting from branches 
within a DVD packet stream (i.e., branches between differ- 
ent segments of the DVD packet stream) is reset to zero. In 10 
step 404, a DVD packet is read, or a branch within the 
stream is detected. The packet may be the first packet of a 
new segment of packets within the stream (for example, 
after a branch has occurred, or when reading of the DVD 
packet stream first begins), or it may be a packet other than 15 
the first packet of a segment of packets within the stream, 
such that at least one packet of the segment has already been 
read. 

In step 406, it is checked whether there has been a branch 
to a new segment. If the segment is new, then in step 408, 20 
the variable Tacc is incremented by the time gap between the 
end of the old (previous) segment and the beginning of the 
new segment. In the case where the reading of the data 
stream has only immediately just begun, the end of the old 
(previous) segment is assumed to be zero, as those of 25 
ordinary skill within the art can understand. Data within the 
DVD stream indicates the timestamps for the beginning and 
end of all segments of packets, such that the time gap by 
which Tacc is incremented does not need to be specifically 
computed as was described in the method of FIG. 3. 30 
However, those of ordinary skill in the art can appreciate that 
the particular case of FIG. 4 relating to DVD streams is 
nevertheless inclusive within the general case of FIG. 3. The 
method then goes from step 410 back to step 404, to read the 
next packet (viz., the first packet of the new segment). 35 

If a new segment was not found in step 406, the data 
packet is checked in step 410 as to whether it includes or 
corresponds to a timestamp Tabs (the time stamp, for 
example, may not be within the packet itself). If it does not, 4Q 
the next packet is read, reverting control back to step 404. 
However, if the data packet does include or correspond to a 
timestamp Tabs, then in step 412 the timestamp is extracted, 
computed or read, as known within the art. In step 414 the 
timestamp Tabs is modified as Trel=Tabs minus Tacc. This 45 
new timestamp is reencoded in step 416, and passed to the 
appropriate substream decoder. Control then proceeds back 
to step 404, to read the next packet. Those of ordinary skill 
within the art can of course appreciate that if the last packet 
has been read, the method of FIG. 4 ends, but this is not 
shown explicitly in FIG. 4. 

A particular method for application of an embodiment of 
the invention to DVD has been described. This method is an 
application of the general method according to an embodi- 
ment of the invention that was described in the previous 55 
section of the detailed description. 

Conclusion 

Timestamp modification for seamless branching within a 
packet data stream has been described. In particular both a 60 
method and a system according to embodiments of the 
invention have been described. A specific method according 
to one embodiment of the invention for application to DVD 
has also been described. 

Although specific embodiments have been illustrated and 65 
described herein, it will be appreciated by those of ordinary 
skill in the art that any arrangement which is calculated to 



50 



achieve the same purpose may be substituted for the specific 
embodiments shown. This application is intended to cover 
any adaptations or variations of the present invention. For 
example, embodiments of the invention have been described 
where the variable Tabs is inherent within the data stream 
itself. However, the invention is not so limited. For example, 
the Tabs variable may not be in the stream — and thus 
externally computed — or it may not be necessarily at the 
point within the stream at which the packet corresponding to 
a given Tabs variable corresponds is. Therefore, it is mani- 
festly intended that this invention be limited only by the 
following claims and equivalents thereof. 
We claim: 

1. A computerized system comprising: 

a plurality of multimedia play devices, each device receiv- 
ing and playing data intended for the device; and, 

a multimedia read device reading a stream of packets, 
decoding the packets into data, and sending the data to 
a corresponding multimedia play device at appropriate 
times, 

the appropriate times being based on relative timestamps 
accounting for accumulated time gaps resulting from 
branches within the stream. 

2. The computerized system of claim 1, wherein each 
packet of the stream has a corresponding substream, and the 
multimedia read device comprises: 

a plurality of substream decoders, each substream decoder 
receiving packets of a corresponding substream, decod- 
ing the packets into data and sending the data to a 
corresponding multimedia play device at the appropri- 
ate times; 

a demultiplexer receiving packets and sending each 
packet, including a relative timestamp, to the substream 
decoder corresponding to the substream of the packet; 
and, 

a stream decoder decoding the stream of the packets, and 
sending each packet to the demultiplexer with a relative 
timestamp. 

3. The computerized system of claim 1, wherein the 
relative timestamps are calculated by the multimedia read 
device according to the formula: 

7rcl=rabs -Tacc, 

where Trcl is a relative time, Tabs is an absolute time as 
discerned from an absolute timestamp from the stream, and 
Tacc is the accumulated time gaps resulting from branches 
within the stream. 

4. The computerized system of claim 1, wherein the 
accumulated time gaps resulting from branches within the 
stream are calculated by the multimedia read device accord- 
ing to the formula: 

racc-7acc+(T abs-7Trom), 

where Tacc is the accumulated time gaps resulting from 
branches within the stream, Tabs is an absolute time as 
discerned from an absolute timestamp from the stream 
immediately after a branch, and Tfrom is an absolute time as 
discerned from an absolute timestamp from the stream at the 
branch. 

5. The computerized system of claim 1, wherein the 
accumulated time gaps resulting from branches within the 
stream are calculated by the multimedia read device accord- 
ing to the formula: 

7aco7acc+(7"ncwscgmentbcgin- 7bldsegmentend), 
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where Tacc is the accumulated time gaps resulting from a program executed by the processor from the medium to 
branches within the stream, Tnewsegmeotbegin is an abso- maintain the appropriate times based on relative limes- 
lute time as discerned from an absolute timestamp from the tamps accounting for accumulated time gaps resulting 
stream immediately after a branch, and Toldsegmentcnd is from branches within the stream, 
an absolute time as discerned from an absolute timestamp 5 15. The computer of claim 14, wherein the relative 
from the stream at the branch. timestamps are calculated by the program according to the 

6. The computerized system of claim 1, wherein at least formula: 
one of the plurality of multimedia play device is selected 

from the group of multimedia play devices comprising: a TYeWabs-racc, 

video display device, and an audio device. ao where Trel ^ a re l a tive time, Tabs is an absolute time as 

7. The computerized system of claim 6, wherein the video discerned from an absolute timestamp from the stream, and 
display device comprises a monitor. Tacc is the accumulated lime ga ps resulting from branches 

s. The computerized system of claim 6, wherein the audio within the stream 

device comprises an amplifier coupled to at least one 16. The computer of claim 14, wherein the accumulated 

speaker. 15 t j me g a p S resulting from branches within the stream are 

9. The computerized system of claim 1, wherein the calculated by the program according to the formula: 
multimedia read device comprises a digital-video disc 

(DVD) player. 7acc=racc+(rabs-7Trom), 

10. A multimedia read device for reading a stream of where Xacc is lhe accumuIated lirae gaps resulting from 
packets, each packet having a corresponding substream, 20 brancnes within the stream, Tabs is an absolute time as 
comprising: discerned from an absolute timestamp from the stream 

a plurality of substream decoders, each substream decoder immediately after a branch, and Tfrom is an absolute time as 

receiving packets of a corresponding substream, decod- discerned from an absolute timestamp from the stream at the 

ing the packets into data and providing the data as branch. 

output at the appropriate times; 25 17. The computer of claim 14, wherein the computer- 

a demultiplexer receiving packets and sending each readable medium comprises a memory. 

packet, including a relative timestamp, to the substream 18. The computer of claim 14, wherein the multimedia 

decoder corresponding to the substream of the packet; read device comprises a digital video disc (DVD) player. 

and, 19. A computerized method for processing a stream of 

a stream decoder decoding the stream of the packets, and 30 packets, each packet having a corresponding substream, 

sending each packet to the demultiplexer with a relativc comprising: 

timestamp, determining whether the stream at an absolute timestamp 

wherein the appropriate times are based on relative times- composes a branch; 

tamps accounting for accumulated time gaps resulting 35 u P on determining that the stream at the absolute times- 

from branches within the stream. tam P comprises information other than a branch, 

11. The multimedia read device of claim 10, wherein the reading a packet within the stream at the absolute 
relative timestamps are calculated by the stream decoder timestamp, 

according to the formula: calculating a relative time as the absolute time minus an 

40 accumulated time based on accumulated time gaps 

Trel-rabs-Jacc, resulting from branches within the stream, and, 

, ~ . . . . . ^ L . . , . providing the packet, along with the relative time, as an 

where Trel is a relative time, Tabs is an absolute time as output- and 

discerned from an absolute timestamp from the stream, and i . ' ■ * . , . . . , 

Tacc is the accumulated time gaps resulting from branches upon delen ™! n S that lhe u slream at the absoIute Umes " 

within the stream. 45 tamp comprises a branch, 

12. The multimedia read device of claim 10, wherein the M f* a . from -^ e ™ lhe ^ ui \ iim& > , . . 
accumulated time gaps resulting from branches within the performing the branch, such that the absolute time is 
stream are calculated by the stream decoder according to the . a vanc ^ . 

formula- s incrementing the accumulated time by the absolute 

50 time, as advanced, minus the from-time. 

racc-racc+(rabs-:r&oin), 20. The computerized method of claim 19, wherein the 

stream of packets is read from a digital video disc (DVD), 
where Tacc is the accumulated time gaps resulting from 21. A computer-readable medium having computer- 
branches within the stream, Tabs is an absolute time as executable instructions that when executed, perform actions 
discerned from an absolute timestamp from the stream 55 comprising reading a stream of packets, decoding the pack- 
immediately after a branch, and Tfrom is an absolute time as ets into data, and providing the data as output at the 
discerned from an absolute timestamp from the stream at the appropriate times, the computer-executable instructions 
brancn - maintaining the appropriate times based on relative times- 

13. The multimedia read device of claim 10, wherein the tamps acc0 unting for accumulated time gaps resulting from 
stream of packets is read by the multimedia read device from branches within the stream. 

a digital video disc (DVD). 22. The computer-readable medium of claim 21, wherein 

14. A computer comprising: tne rc t at ive timestamps arc calculated by the computcr- 
a processor; executable instructions according to the formula: 

a computer-readable medium; 

a multimedia read device reading a stream of packets, 65 Trcl-rabs-racc, 

decoding the packets into data, and providing the data where Trel is a relative time, Tabs is an absolute time as 

as output at the appropriate times; discerned from an absolute timestamp from the stream, and 
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Tacc is the accumulated time gaps resulting from branches 
within the stream. 

23. The computer-readable medium of claim 21, wherein 
the accumulated time gaps resulting from branches within 
the stream are calculated by the computer-executable 
instructions according to the formula: 

racc=racc+(7abs-nrom), 

where Tacc is the accumulated time gaps resulting from 
branches within the stream, Tabs is an Absolute time as 
discerned from an absolute timestamp from the stream 
immediately after a branch, and Tfrom is an absolute time as 
discerned from an absolute timestamp from the stream at the 
branch. 

24. The computer-readable medium of claim 21, wherein 
the medium is selected from the group of mediums consist- 
ing of: a floppy disk, a compact-disc read-only-memory 
(CD-ROM), and a memory. 

25. A computerized method for processing a stream of 
DVD packets, comprising: 

reading a packet within the stream; 
determining whether the packet is part of a new segment 
within the stream; 

upon determining that the packet is part of a new segment 
within the stream, 

calculating an accumulated time; determining whether 
the packet has a timestamp; and, upon determining 
that the packet has a timestamp, 

extracting the timestamp from the packet, 

modifying the timestamp to account for the accumu- 
lated time, and 

reencoding the timestamp as modified within the 
packet. 

26. The computerized method of claim 25, wherein the 
stream of packets is read from a digital video disc (DVD). 

27. The computerized method of claim 25, further com- 
prising passing the reencoded timestamp to a substream 
decoder. 

28. The computerized method of claim 25, wherein modi- 
fying the timestamp to account for the accumulated time 
further comprises calculating relative timestamps according 
to the formula: 

7 re 1=7 abs- Tacc, 

where Trel is a relative time, Tabs is an absolute time as 
discerned from an absolute timestamp from the stream, and 
Tacc is the accumulated time gaps resulting from branches 
within the stream, 

29. A computerized system comprising: 

a plurality of multimedia play devices, each device receiv- 
ing and playing data intended for the device; and 

a multimedia read device reading a stream of packets, 
decoding the packets into data, and sending the data to 
a corresponding multimedia play device at appropriate 
times, 

the appropriate times being based on relative timestamps 
accounting for accumulated time gaps resulting from 
branches within the stream, wherein the relative times- 
tamps are calculated by the multimedia read device 
according to the formula: 

rrel-rabs-Tacc, 

where Tre! is a relative time, Tabs is an absolute time as 
discerned from an absolute timestamp from the stream, and 
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Tacc is the accumulated time gaps resulting from branches 
within the stream. 

30. A computerized system comprising: 

a plurality of multimedia play devices, each device receiv- 
ing and playing data intended for the device; and 

a multimedia read device reading a stream of packets, 
decoding the packets into data, and sending the data to 
a corresponding multimedia play device at appropriate 
times, wherein the appropriate times are based on 
relative timestamps accounting for accumulated time 
gaps resulting from branches within the stream, 
wherein the accumulated time gaps resulting from 
branches within the stream are calculated by the mul- 
timedia read device according to the formula: 

racc=7acc+(7abs-7Trom), 

where Tacc is the accumulated time gaps resulting from 
branches within the stream, Tabs is an absolute time as 
discerned from an absolute timestamp from the stream 
immediately after a branch, and Tfrom is an absolute time as 
discerned from an absolute timestamp from the stream at the 
branch. 

31. A computerized system comprising: 

a plurality of multimedia play devices, each device receiv- 
ing and playing data intended for the device; and 

a multimedia read device reading a stream of packets, 
decoding the packets into data, and sending the data to 
a corresponding multimedia play device at appropriate 
times, 

the appropriate times being based on relative timestamps 
accounting for accumulated time gaps resulting from 
branches within the stream, wherein the accumulated 
time gaps resulting from branches within the stream are 
calculated by the multimedia read device according to 
the formula: 

racc»7acc+(7newsegme ntbegin- 7bldsegme n tend), 

where Tacc is the accumulated time gaps resulting from 
branches within the stream, Tnewsegmentbegin is an abso- 
lute time as discerned from an absolute timestamp from the 
stream immediately after a branch, and Toldsegmentend is 
an absolute time as discerned from an absolute timestamp 
from the stream at the branch. 

32. A multimedia read device for reading a stream of 
packets, each packet having a corresponding substream, 
comprising: 

a plurality of substream decoders, each substream decoder 
receiving packets of a corresponding substream, decod- 
ing the packets into data and providing the data as 
output at the appropriate times; 

a demultiplexer receiving packets and sending each 
packet, including a relative timestamp, to the substream 
decoder corresponding to the substream of the packet; 
and 

a stream decoder decoding the stream of the packets, and 
sending each packet to the demultiplexer with a relative 
timestamp, 

wherein the appropriate times are based on relative times- 
tamps accounting for accumulated time gaps resulting 
from branches within the stream, wherein the relative 
timestamps are calculated by the stream decoder 
according to the formula: 

7rel-7abs-Tacc, 

where Trel is a relative time, Tabs is an absolute time as 
discerned from an absolute timestamp from the stream, and 
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Tacc is the accumulated time gaps resulting from branches discerned from an absolute timestamp from the stream 

within the stream. immediately after a branch, and Tfrom is an absolute time as 

33. A multimedia read device for reading a stream of discerned from an absolute timestamp from the stream at the 
packets, each packet having a corresponding substream, branch. 

comprising: 5 36. A computer-readable medium having a program 

a plurality of substream decoders, each substream decoder stored thereon for execution on a suitably equipped com- 

receiving packets of a corresponding substream, decod- puter having a multimedia read device coupled thereto, the 

ing the packets into data and providing the data as device reading a stream of packets, decoding the packets 

output at the appropriate times; into data, and providing the data as output at the appropriate 

a demultiplexer receiving packets and sending each 10 times ' the program maintaining the appropriate times based 

packet, including a relative timestamp, to the substream 00 relative timestamps accounting for accumulated time 

decoder' corresponding to the substream of the packet; gaps resulting from branches within the stream, wherein the 

anc j relative timestamps are calculated by the program according 

a stream decoder decoding the stream of the packets, and 10 me ^ orrnu ^ a - 

sending each packet to the demultiplexer with a relative 35 7Yei«7abs-7acc, 
timestamp, 

wherein the appropriate times based on relative times- where Trel ^ a relative time > Tab s is an absolute time as 

tamps accounting for accumulated time gaps resulting discerned from an absolute timestamp from the stream, and 

from branches within the stream, wherein the accumu- 2Q Tacc is tne accumulated time gaps resulting from branches 

lated time gaps resulting from branches within the within the stream. 

stream are calculated by the stream decoder according 37 - A computer-readable medium having a program 

to the formula: stored thereon for execution on a suitably equipped com- 
puter having a multimedia read device coupled thereto, the 

r3cc-7acc+(7abs-rfrom), ' device reading a stream of packets, decoding the packets 

where Tacc is the accumulated time gaps resulting from ^to data, and providing the data as output at the appropriate 

branches within the stream, Tabs is an absolute time as times > the P ro S ram maintaining the appropriate times based 

discerned from an absolute timestamp from the stream on relat1 ^. stam P? ^counting for accumulated time 

immediately after a branch, and Tfrom is an absolute time as gaps res 1 ultl ^ from branches within the stream, wherein the 

discerned from an absolute timestamp from the stream at the 30 accumulated ^ B a ps resulting from branches within the 

5 ranc h stream are calculated by the program according to the 

34. A computer comprising: formula: 

a processor; 7acc=.racc+(rabs-7Trom) f 

a computer- readable medium: , _ , > , , . . 

K .,. j j • • • A r . - e where Jacc is the accumulated time gaps resulting from 

a multimedia read device readme a stream of packets, 35 i *u . t u • i_ t , , • 

, , . i * * * j * j -j. F" v ™ u *> branches within the stream, Tabs is an absolute time as 

decoding the packets into data, and providing the data discerned ffom aQ limest from me stream 

as output at the appropriate times; immediately after a branch, and Tfrom is an absolute time as 

a program executed by the processor from the medium to discerned from an absolute timestamp from the stream at the 

maintain the appropriate tunes based on relative times- branch 

tamps accounting for accumulated time gaps resulting 40 38 A digital video disc player, wherein each packet of a 

from branches within the stream, wherem the relative pluralily of packets has a mmspoiaiDg substre am, and the 

timestamps are calculated by the program according to di ital vide0 disc la comprises: 

the formula: . , * / , *\ , , 

a plurahty of substream decoders, each substream decoder 

rrel-7abs-7acc, 45 t0 receive a plurality of packets of a corresponding 

l <-p i- I* *- L i - substream, each packet having a relative timestamp, to 

where Trel is a relative time, Tabs is an absolute time as decode the kets imo d and tQ ^ the dat / tQ a 

discerned from an absolute timestamp from the stream, and corresponding multimedia play device at the relative 

lace is the accumulated tune gaps resulting from branches timestamp- 

within the stream. . lt . t t . , , 

35. A computer comprising: 50 a dem«lUpl«er to receive packets and send each packet, 
a processor including a relative timestamp, to the substream 

' decoder corresponding to the substream of the packet; 

a computer-readable medium; and - 

a multimedia read device reading a stream of packets, a decoder t0 decode the lura|k of lhe cket ca , culate 

decoding the packets into data, and providing the data 55 accumulated time gaps that result from branches within 

as output at the appropriate times; lhe pluralily of packets for eacfa Qf ^ plufality rf 

a program executed by the processor from the medium to packets, calculate a relative timestamp that accounts for 

maintain the appropriate times based on relative times- the accumulated time gaps, and send each packet to the 

Umps accounting for accumulated time gaps resulting demultiplexer with the corresponding relative times- 

from branches within the stream, wherein the accumu- go tamp. 

lated time gaps resulting from branches within the 39. The digital video disc player of claim 38, wherein the 
stream are calculated by the program according to the decoder calculates each of the plurality of relative times- 
formula: tamps as a plurality of accumulated time gaps resulting from 
racc-racc + (rabs-nrom) branches within the plurality of packets subtracted from an 

65 absolute timestamp from the plurality of packets, 

where Tacc is the accumulated time gaps resulting from 40/rhe digital video disc player of claim 38, wherein the 

branches within the stream, Tabs is an absolute time as accumulated time gaps resulting from branches within the 
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plurality of packets are calculated by the decoder as an 
absolute time as discerned from an absolute timestamp from 
the plurality of packets at the branch that is subtracted from 
the sum of the accumulated time gaps resulting from 
branches within the plurality of packets and an absolute time s 
as discerned from an absolute timestamp from the plurality 
of packets immediately after a branch. 

41. The digital video disc player of claim 38, wherein the 
digital video disc player is part of a computer having a 
processor, a computer-readable random-access memory 10 
medium, and another computer- readable medium, wherein a 
computer program operable to execute on the computer- 
readable random-access memory medium by the processor 

of the computer, to calculate the relative timestamp, and 
send the relative timestamp to the decoder. as 

42. The digital video disc player of claim 38, wherein the 
multimedia play device is selected from the group of mul- 
timedia play devices comprising: a video display device, and 
an audio device. 

43. The digital video disc player of claim 42, wherein the 20 
video display device comprises a monitor. 

44. The digital video disc player of claim 42, wherein the 
audio device comprises an amplifier coupled to at least one 
speaker. 

45. The digital video disc player of claim 38, wherein the 25 
digital video disc player is an internal component of a 
computer. 

46. The digital video disc player of claim 38, wherein the 
digital video disc player is a component within a stereo 
system. 30 

47. A computer comprising: 
a processor; 

a computer-readable medium; 

a multimedia read device reading a stream of packets, 35 
decoding the packets into data, and providing the data 
as output at the appropriate times; arid 

logic on the computer-readable medium and executable 
by the processor from the computer-readable medium 
to maintain the appropriate times based on a plurality of 40 
relative timestamps in account of a plurality of accu- 
mulated time gaps that result from branches within the 
stream. 

48. The computer of claim 47, wherein each of the 
plurality of relative timestamps are calculated as a plurality 45 
of accumulated time gaps resulting from branches within the 
stream subtracted from an absolute timestamp from the 
stream. 

49. The computer of claim 47, wherein the accumulated 
time gaps resulting from branches within the stream are 50 
calculated by the logic as an absolute time as discerned from 

an absolute timestamp from the stream at the branch that is 
subtracted from the sum of the accumulated time gaps 
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resulting from branches within the stream and an absolute 
time as discerned from an absolute timestamp from the 
stream immediately after a branch. 

50. The computer of claim 47, wherein the computer- 
readable medium comprises a memory. 

51. The computer of claim 47, wherein the multimedia 
read device comprises a digital video disc (DVD) player. 

52. A method for processing a stream of packets, each 
packet having a corresponding substream, comprising: 

reading a stream of packets; 
decoding the packets into data; 

accounting for accumulated time gaps resulting from 
branches within the stream; 

determining a plurality of times based on relative times- 
tamps and the accumulated time gaps; and 

sending the data to a corresponding multimedia play 
device at the plurality of times. 

53. The method of claim 52, wherein the stream of 
packets is read from a digital video disc (DVD). 

54. A computer- readable medium having a program 
stored thereon for execution on a suitably equipped com- 
puter having a multimedia read device coupled thereto, the 
program, when executed, directing the device to perform 
tasks comprising: 

reading a stream of packets; 
decoding the packets into data; 

accounting for accumulated time gaps resulting from 
branches within the stream; 

determining a plurality of times based on relative times- 
tamps and the accumulated time gaps; and 

sending the data to a corresponding multimedia play 
device at the plurality of times. 

55. The computer-readable medium of claim 54, wherein 
each of the plurality of relative timestamps are calculated as 
a plurality of accumulated time gaps resulting from branches 
within the stream subtracted from an absolute timestamp 
from the stream. 

56. The computer-readable medium of claim 54, wherein 
the accumulated time gaps resulting from branches within 
the stream are calculated as an absolute time as discerned 
from an absolute timestamp from the stream at the branch 
that is subtracted from the sum of the accumulated time gaps 
resulting from branches within the stream and an absolute 
time as discerned from an absolute timestamp from the 
stream immediately after a branch. 

57. The computer-readable medium of claim 54, wherein 
the medium is selected from the group of mediums consist- 
ing of: a floppy disk, a compact -disc read-only-memory 
(CD-ROM), and a memory. 

***** 



06/25/2004, EAST Version: 1.4.1 



UNITED STATES PATENT AND TRADEMARK OFFICE 



CERTIFICATE OF CORRECTION 



PATENT NO. 
DATED 



: 6,490,405 Bl 
: December 3, 2002 



Page 1 of 1 



INVENTOR(S) : Speed etal. 

It is certified that error appears in the above- identified patent and that said Letters Patent is 
hereby corrected as shown below: 



Column 11, 

Line 8, replace "device" with - devices --. 
Column 13, 

Line 10, replace "Absolute" with absolute --. 



Signed and Sealed this 



Eighth Day of April, 2003 




JAMES E. ROGAN 
Director of the United States Patent and Trademark Office 



06/25/2004, EAST Version: 1.4.1 



